New lower bounds on the non-zero capacity of Pauli Channels 
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We study encodings that give the best known thresholds for the non-zero capacity of quantum 
channels, i.e., the upper bound for correctable noise, using an entropic approach to calculation of 
the threshold values. Our results show that Pauli noise is correctable up to the hashing bound. 
For a depolarizing channel, this approach allows one to achieve a non-zero capacity for a fidelity 
(probability of no error) of / = 0.80870. 
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This paper complements [l(, which investigated how 
a given quantum error correcting code can best correct 
a particular type of noise. That work made use of an 
entropic approach to calculation of thresholds of cor- 
rectable noise, showing that an adaptive concatenation 
of the quantum code can improve the thresholds. In this 
paper, we apply the same entropic approach to finding 
the best known code for correcting a particular type of 
noise. We find codes that can correct all Pauli noise up 
to the hashing bound, i.e., the error rate per bit when the 
Shannon entropy of the noise S (AT) = 1 , disproving the 
conjecture [|[ that there exists some uncorrectable Pauli 
noise below the hashing bound. 

We first review the background to the current work. 
From classical information theory, we know that the bi- 
nary symmetric channel capacity (rate per bit at which 
information can be transmitted reliably using a large 
enough code) of some noise Af is given as Qi = 1 — S(Af), 
where S(Af) is the Shannon entropy of the noise 0. 
However, to get the true (optimal) quantum capacity 
of some noise, we must maximize the capacity over all 
codes of various lengths n, to arrive at a quantum ca- 
pacity Q = lim n ^oo ig„ > Qi d, H i, i, [|, where Q n 
is the maximum over a particular length. This paper 
is concerned with finding the threshold noise values at 
which the quantum channel capacity goes to zero: these 
thresholds constitute the limits of correctable noise. It 
had originally been conjectured that Q = Qi [8], but it 
was subsequently found [1, H, [TiJ that some codes can 
correct above the noise values for which Qi = 0, im- 
plying that Q > Q\. We shall refer to the noise values 
for which S(Af) = 1 as the quantum Shannon hashing 
bound. Some codes that were shown to allow correc- 
tion above the hashing bound consist of an n\ qubit bit 
flip code concatenated with an ni qubit phase flip code 
[3, We shall refer to these as "ni in n 2 " codes, since 
each of the n 2 blocks of the phase flip code consists of 
an ni qubit bit flip code. In Ref. these codes were 
concatenated with a random code to arrive at good codes 
that allow correction. In this work we show that when 
these ni in ri2 codes are instead repeatedly concatenated 
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with the [[5, 1, 3]] code introduced in [Tl(, we obtain the 
best known thresholds for correcting quantum noise. 

The entropic approach to evaluation of the error 
threshold is as follows. After we encode one logical qubit 
into n physical qubits with a quantum error correcting 
code, we calculate the average of the Shannon entropy 
over all error syndromes, weighted by their probability of 
occurrence. If the average Shannon entropy of the logical 
noise is less than the hashing bound of 1, then concatena- 
tion with a random code will result in a good code that 
allows complete correction of the noise [l(| • In this pa- 
per, we use repeated concatenation with a specific code 
(the [[5, 1, 3]] code) rather than a random code. The logi- 
cal entropy is evaluated at successive levels of concatena- 
tion, using the procedure outline in [1| . The entropy as a 
function of concatenation level shows one of three behav- 
iors, depending on the value of the error probability: i) 
for small error probabilities, S (AT) decreases with level n 
to reach an asymptotic value of zero; ii) for one specific 
error probability value, following some initial variation 
with n, S(Af) goes to a constant value, usually approx- 
imately 1; iii) for larger error probability values, S(Af) 
increases to an asymptotic value, which is always 2 for 
the [[5,1,3]] code, although it could be 1 in special cases 
for other types of codes. Fig. [1] illustrates the average 
Shannon entropy as a function of concatenation level for 
depolarizing noise with the [[5,1,3]] code concatenated 
repeatedly with itself. The entropy versus concatenation 
level is shown for three different error probability values 
that illustrate the three generic behaviors: p = 0.062 
(below threshold), p — 0.629965 (close to threshold) and 
p = 0.064 (above threshold). 

In case i), the error can be corrected once the asymp- 
totic value of zero is achieved, since the nature of the er- 
ror is then known. Case iii) corresponds to a combination 
of errors, with the maximum asymptotic value of 2 corre- 
sponding to depolarizing noise (px,PY,Pz) = (\,\,\)- 
This channel results in the maximally mixed state, and 
cannot be corrected since there is no information on the 
nature of the error. Thus case ii), where the average 
Shannon entropy is asymptotically constant, provides the 
threshold error probability value of correctable noise, i.e., 
below the error probability for this value of S(Af), the 
noise can be corrected. An entropy of corresponds to 
a known correctable error, so the level of concatenation 
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TABLE I: Upper bound on correctable noise, i.e., threshold 
value, for Pauli noise channel (px,PY,pz) = (f>, 10~ 6 , 1CT 







By definition, the hashing bound 


is the threshold value for 






level 0, i.e., 


no concatenation. 








Level 


[[5,1,3]] 


5 in 5 code 









49.62410483% 


49.62410483% 






1 


49.64614794% 


49.64614908% 






2 


49.66961046% 


49.66961385% 



2 4 6 8 10 

Level of concatenation of [[5,1,3]] code 

FIG. 1: (Color online) Shannon entropy of depolarizing noise 
px = Py — Pz = p after variable levels of self-concatenation 
of the [[5, 1, 3]] code, for noise at the threshold (p ~ 6.29965%) 
as well as somewhat below (p = 6.2%) and above (p = 6.4%) 
the threshold. These values are obtained from Monte Carlo 
simulation, with error bars considerably smaller than the plot- 
ted symbols. 



at which zero entropy is first reached explicitly defines a 
code that can correct all errors up to the corresponding 
error probability threshold value. This procedure yields a 
code for a single error-free qubit. To achieve a non-zero 
capacity, we stop after a certain number of levels and 
then concatenate with a random code as in Refs. @, [T^. 

The n qubit bit flip code is the n qubit repetition code 
which encodes 1 logical qubit into n physical qubits and 
which has encoded states |0) = |0}® n and |1) = 
The n qubit phase flip code has the encoded states |+) = 
\+f n and H = \-f n , where |±) = J=|0> ± ^|1>. We 
now consider the n\ in n.2 code. If this were concatenated 
repeatedly with itself, the resulting logical noise would 
tend to be unbalanced in terms of phase errors and bit 
flip errors, and therefore tend to be dominated by either 
X or Z errors. In this situation we have found that it 
is hard to calculate the thresholds for which the entropy 
is unity using Monte Carlo, since this point becomes an 
attracting fixed point for the bit flip and phase flip codes. 

Instead, we use the n\ in ri2 code as input to repeated 
concatenation with the [[5, 1,3]] code. Our rationale for 
this procedure is the fact that the [[5,1,3]] code is also 
very efficient at correcting noise dominated by one type 
of error. In particular, if there is probability p of a single 
Pauli error a and probability 1 — p of no error, with the 
exception of the special case that when p = 50%, the 
[[5, 1, 3]] code can always correct the error. To illustrate 
this, Tab. |T] shows an example of the performance of a 
self-concatenated [[5,1,3]] code for X-dominated error, 
compared to that of a self-concatenated 5 in 5 code. We 
see that both codes can correct noise dominated by X 
errors above the hashing bound and that the thresholds 
for the [[5, 1, 3]] code are just below that of the combined 
bit flip/phase flip 5 in 5 code. Similar results are found 



for noise dominated by Z errors. 

An important consequence of repeatedly concatenat- 
ing the initial bit flip/phase flip n\ in 712 code with the 
[[5, 1, 3]] code, is that when the noise is below the thresh- 
old value, the logical entropy converges to with increas- 
ing concatenation level. This means that the logical noise 
converges to a single Pauli error and can be corrected, 
as outlined above and demonstrated in [1(. Therefore 
this combination of ri\ in n<i followed by concatenation 
with [[5, 1, 3]] gives a constructive approach for correcting 
all noise below the threshold. To compute the thresh- 
olds from repeated concatenation, we first estimate the 
threshold after the n\ qubit bit flip code is followed by 
the 712 qubit phase flip code and then by some fixed num- 
ber of levels of the [[5,1,3]] code. This fixed number is 
chosen to maximize the lower part of the confidence in- 
terval in the Monte Carlo evaluation of thresholds (see 
below for a discussion of the Monte Carlo simulations). 
The true threshold value is then obtained from further 
repeated concatenation with the [[5,1,3]] code, resulting 
in a slightly higher value than the value p ~ 0.062995 
shown in Fig. [T] 

If the probabilities of Pauli errors a occurring on a 
single qubit are p & , the Shannon entropy is 

S(M) = H(p!,p x ,PY,Pz) = ^2h(p a ), 



where 



h(x) = — x\og 2 x. 



px is the probability of a pure bit flip error (without a 
phase error), pz the probability of a pure phase error 
(without a bit flip error) and py the probability of a 
combined bit flip and phase flip error. The fidelity / is 
defined to be the probability of no error, i.e., pi. We now 
consider how to construct the entropy for logical errors 
in encoded qubits, first without concatenation and then 
with repeated concatenation. 

Lemma 1 Suppose that there is identical independent 
noise on each qubit of an n qubit bit flip code, with p a 
representing the probability of a a Pauli error. The prob- 
ability of measuring a syndrome that corresponds to an 
error of distance k and associated logical a error is l a {k), 
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where 



h{k) 



a k + b k 



lx(k) 



W{k) 



Q>n — k bn — k 



lz{k) 



a n -k + b n -k 
2 

ak - b k 



(1) 



and 



i — k 



b k = ('.") (px - pv) k (Pi - PzT 1 



For the special case of k 
have 



due to double counting we 



n n an + o 

n n ftii — bi 

i Y q) = i z (-) = ^ 



(2) 



Here qx represents the total probability of some sort of 
bit flip error (that is an X or a Y) Pauli error. Therefore, 
qx =Px +Py- 

Proof: The probability of no logical bit flip error, lj(k) + 
lz{k), is the binomial distribution of qx, which is defined 
above as a k . The complement of this is the probability 
of a logical bit flip error, lx(k) + W{k) — a„_fc. 

Suppose we have two independent noise sources for 
phase errors on single qubits, with probabilities p\ andj>2 
of occurring. Then the total resulting probability of an 
error is p = - — ( 1 ~ 2 pi)( 1 ~ 2 P2) ^ wn j cn j s a classical result. 

In the following, we derive all four logical error prob- 
abilities l a {k) by analyzing the probabilities of logical 
phase errors. First we look at the case where there is 
a logical phase error but no logical bit flip error. On 
k qubits, there are no bit flip errors, and p\ — px + Pz 1S 
the conditional probability of a phase error. On the other 
n — k qubits, there are bit flip errors, and P2 = 



PX+PY 

is the conditional probability of a phase error. Thus the 
conditional probability of a logical phase error is 



lz(k) 



l-(l-2 Pl ) fc (l-2p 2 ) 



h(k)+lz(k) 

1 _ 1 ^Px 

2 2 p x +py ' y pi +pz 



PY Ak,Pl 



PZ 



r 



2 a k 



Using the fact that li(k) + lz{k) — ak, we can eliminate 



Zj(fc) to obtain lz(k) 



— and hence li(k) 



a-k+bk 



2 1 yj 2 _ • 

Now we examine the case when there are both a logical 

bit flip error and a logical phase flip error. When we have 
distance k logical phase flip and bit flip errors together, 
the conditional logical probability of a distance k phase 
flip error is i x ^+i Y ( k ) ■ ^ e note tnat *° cause a logical 
bit flip error of distance k (n — k), there must actually 
be n — k (k) bit flip errors. Therefore, this conditional 
probability can also be written as the logical probability 



of a distance n~k phase flip given no n — k bit flip errors, 

ll{n ! z k\l^} n -k) - Hence we have 



W{k) 



l z {n - k) 



W) 



lx{k)+W{k) h{n- k) +l z {n- k) 

Using the fact that lx(k) + W{k) — a n _ k , this gives 
l Y (k) = a — k - b "- k and therefore l x (k) = a —«+ b —\ 



Corollary 2 The total logical entropy resulting from an 
n qubit bit flip code is 

E E = E ( - Km) + E h (i*(k))) , 

k=0 a ^ ' k=0 a 

where l(k) — ^2 a l<j(k) is the probability of a syndrome 
corresponding to a distance k error. l(k) = a k + a n — k 
except in the special case of k — j, where l{^) = 8| 
because of double counting (see also Eq.\^. 

Proof: The conditional probability of having a logical a 
error, given that there was a distance k error measured, 
Weighted by the probability l(k) of a distance 

k error being measured, this contributes to 
the total entropy. Summing over all k and a gives the 
desired result. ■ 

To show how the logical entropy is then evaluated af- 
ter the code is concatenated we use the example of an 
rii = 5 bit flip code concatenated with an n-i qubit phase 
flip code. First, we calculate the values of l a (k) for the 
3 error syndromes corresponding to distance k = 0, 1,2 
errors. There are 3 corresponding types of sub-blocks, 
each with a distance 0, 1, or 2 error. For each of these 
3 types of sub-blocks, the ri2 qubit phase flip code can 
either have an error detected on that block or not, re- 
sulting in v = 6 different possible error cases for a block. 
Second, a multinomial expansion of these 6 cases is per- 
formed. This allows for exact calculations for the n\ = 5 
in ri2 code thresholds. In general, the number of cases to 
consider is the number of ways for v non-negative inte- 

gers to sum to n2 , which is approximately nj^xTi • ^ or oa -d 
rii, there are v = n\ + 1 cases. The most time intensive 
exact calculation performed for this paper was for the 7 
in 134 code: this requires approximately 1.5 x 10 11 steps, 
a calculation that takes on the order of weeks on typ- 
ical 2008 CPU. The Monte Carlo simulations on larger 
systems described below took up to 5 x 10 12 steps, with 
the largest simulation taking on the order of months on 
a typical 2008 CPU. 

Some calculations in this paper use a Monte Carlo 
method to estimate the error thresholds, in particular, 
the calculations for the doubly concatenated codes having 
an additional j levels of concatenation with the [[5, 1, 3]] 
code. The threshold values are defined as the noise values 
for which the entropy is a constant value (usually 1, as 
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discussed above) for a given ri\ qubit bit flip code in a 7J2 
qubit phase flip code, which is then further concatenated 
with the [[5,1,3]] code. At the first level of encoding (it 
need not be the same code at each level) , the same noise 
is applied on each qubit. At each block of each level, a 
syndrome is chosen randomly from the error syndromes, 
weighted by their probability of occurrence. The result- 
ing probabilities of logical errors l a are computed, and 
the logical noise from each block of one level is passed 
on as noise on a single qubit to the next level of the 
code. At the top level of the code, the total logical errors 
l a are computed, and the resulting Shannon entropy of 
the errors H(li,lx,W,lz) then computed. This entropy 
is then averaged over many Monte Carlo samples of the 
first level logical error probabilities to obtain a statistical 
estimate of the Shannon entropy of the total logical noise. 
(The same Monte Carlo method was used in [lj].) The 
simulations are run for highly divisible values of by 
treating the ni phase flip code as several phase flip codes 
concatenated with themselves, since there is a lot of over- 
head associated with having a large code at one level of 
the encoding. All results obtained with Monte Carlo are 
shown with the standard error, which corresponds to a 
68% confidence interval. 

For an example of how the concatenation of syndromes 
works, suppose that we have the ri\ = 2 qubit bit flip 
code concatenated into the ni — 3 qubit phase flip code. 
Now suppose that the error recovery operator for the first 
block is J® 7, and for the second and third blocks is I®X 
in each case. Then after the first code (the 2 qubit bit 
flip code), the total recovery operator on the 6 qubits is 
I®I®I®X<&I®X. Now, suppose that the recovery 
operator for the phase flip code is I®I®Z, and encoded 
Z on the bit flip code is Z = I ® Z. This multiplies a 
recovery operator of I® 5 <g> Z, which resulting in a final 
combined recovery operator of I®I®I®X®I®Y. 

In Tab. HH we show noise threshold values obtained for 
the 5 qubit bit flip code concatenated 6 times with the 
2 qubit phase flip code to make a 5 in 64 code which is 
further concatenated repeatedly with the [[5,1,3]] code. 
Calculations were made for three types of Pauli noise: 
depolarizing, independent bit and phase flips, and two- 
Pauli noise. At each level, we determine the error proba- 
bilities p a that give a logical entropy of 1. For the three 
types of noise considered, the thresholds found here are 
close to the optimal values found later in this paper. 

a. Example Suppose that we wish to know the en- 
tropy contribution from the syndrome of distance k = 1 
for the n = 2 qubit bit flip code, under depolarizing noise 
Px = Py = Pz = P- In Eq. [TJ a\ = 4p - 8p 2 , b\ = 0. 
Since k = ^, we have the special case where dividing 
by 2 from Eq. Q] (see discussion below Eq. []} gives us 
Z CT (1) = p — 2p 2 for all a. From Corollary^ the entropy 
for the k = 1 syndrome is therefore 

£ M W> = U0-)h{\) = 4/(1)^ = 8p - 16p 2 . 

The codes presented above are examples of doubly con- 



TABLE II: Threshold values for noise correction by the 5 
qubit bit flip code concatenated 6 times with the 2 qubit 
phase flip code (resulting in the 5 in 2 6 code after 7 levels), 
and then concatenated repeatedly with the [[5, 1, 3]] code. We 
find the values of p for which the logical entropy is 1 at each 
level for different types of errors (px ,Py ,Pz)- (p,p,p) is the 
depolarizing channel, (p — p 2 ,p 2 ,p — p 2 ) represents bit flip 
and phase flip errors occurring independently, and (p,0,p) is 
two-Pauli noise. For the lower levels, the threshold calcu- 
lations may be performed exactly, by numerical inversion of 
the exactly calculated average Shannon entropy. For higher 
levels, the rapidly increasing number of syndromes renders 
exact calculation unacceptably inefficient and the entropy is 
then evaluated by Monte Carlo sampling (see text). For these 
calculations the standard error corresponding to a 68% con- 
fidence interval is shown in standard form as the last digit in 
parentheses. 

Level (p,p,p) {p-p 2 ,p 2 ,p-p 2 ) (p,0,p) 

6.30965616% 11.00278644% 11.35460976% 

1 6.34520294% 11.21042175% 11.33392680% 

2 6.34750308% 11.21331544% 11.33595709% 

3 6.35074316% 11.21812585% 11.33994152% 

4 6.35541320% 11.22592213% 11.34718019% 

5 6.36255660% 11.23929192% 11.36035645% 

6 6.37084591% 11.25886132% 11.37968385% 

7 6.37272029% 11.27375652% 11.39372640% 

8 6.373(5)% 11.275% 11.395(1)% 

9 6.375% 11.277% 11.397% 

10 6.376% 11.27(7)% 11.398% 
oo 6.376% 11.27(8)% 11.39(8)% 



catenated codes, where the first concatenation construct- 
ing the ni in code is finite and the second, subsequent 
concatenation of this with the [[5, 1, 3]] code is unlimited. 
The latter concatenation allows the average Shannon en- 
tropy of the logical errors and hence the rate of unknown 
errors to be driven to zero, while the first, finite concate- 
nation provides an additional parameter, ri2, that can be 
optimized to find the highest possible threshold values. 

In Sections HI - Mil we present examples of optimization 
of these doubly concatenated codes for several different 
Pauli noise models described by one or two noise pa- 
rameters. In Section HVl we present threshold results for 
correction of independent noise in all three Pauli degrees 
of freedom, using an infinite length bit flip code. 



I. DEPOLARIZING NOISE 

Depolarizing noise is noise of the form (j>x,Py,Pz) = 
(p,p,p). For a bit flip code with n\ qubits, values of p 
for which the logical entropy is 1 are given in Tab. IIIII 
Previous work [l0( has shown that n\ = 5 is optimal 
for this class of codes (termed 'cat' codes in [10( and 
'repetition' codes in [3]), and that this code also corrects 
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FIG. 2: (Color online) Thresholds of non-zero capacity for the depolarizing channel for 5 qubit bit flip code concatenated with 
ri2 qubit phase flip code. These values are calculated exactly. 



TABLE III: Values of p for which the logical entropy is 1 for 
an ni qubit bit flip code for noise (px ,Py ,Pz)- Note that 
here the values for rii = 1 correspond to the hashing bound. 
These values are all calculated exactly. 



ni 



(P,P,P) 



(P- 



o 2 ,p 2 ,P 



- p 



(p,o,p) 



TABLE IV: For a given m qubit bit flip code, we find the 
optimal ?i2 phase flip code for correcting depolarizing noise, 
i.e. (px ,Py ,Pz) = (p,p,p). The threshold values are deter- 
mined to be the value of p for which the entropy is equal to 
1. The hashing bound (corresponding to the 1 in 1 code) is 
p = 6.30965616%. These results are determined exactly. 



1 

2 
3 
4 
5 
6 
7 
8 
9 

oo 



6.30965616% 
6.28410724% 
6.33766430% 
6.32983488% 
6.34520293% 
6.33623898% 
6.34108373% 
6.33195564% 
6.33268543% 
6.06394190% 



11.00278644% 
11.00278644% 
11.16520399% 
11.16162540% 
11.21042175% 
11.19383617% 
11.21074102% 
11.19067373% 
11.19549408% 
10.69243112% 



11.35460976% 
11.18454296% 
11.30915446% 
11.29120242% 
11.33392680% 
11.31378370% 
11.32891165% 
11.30752673% 
11.31166177% 
10.79171085% 



m 


Optimal 7i2 


Threshold 


1 


5 


6.34520293% 


2 


1 


6.28410724% 


3 


19 


6.36189692% 


4 


1 


6.32983488% 


5 


51 


6.37338273% 


6 


11 


6.34136778% 


7 


133 


6.36907054% 


8 


38 


6.34112748% 



above the hashing bound. 

Now we consider an n\ qubit bit flip code concatenated 
with an ri2 qubit phase flip code. Previous work Q has 



shown that for n\ = 3, the optimal length for the phase 
flip code is ni = 19, and yields a vanishing logical error 
rate at the threshold value p = 6.32%, corresponding to a 
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TABLE V: Comparison of thresholds found for the depolariz- 
ing channel px = Py — Pz — P with the doubly concatenated 
code (5 in 56 repeated [[5, 1, 3]]) with the optimal 5 in U2 code 
and with previous results for other 5 in 712 codes 0, QiJ and 
for the repetition code (5 qubit bit flip [j|). The threshold 
values for the doubly concatenated code are evaluated with 
the use of Monte Carlo sampling, and the statistical error is 
given as the standard error corresponding to a 68% confidence 
interval. The other threshold values are evaluated exactly. 



Code 



P 



fidelity 



Hashing rate 
5 qubit bit flip [9] 
5 in 5 riO] 
5 in 16 [3] 
5 in 51 
5 in 56 repeated [[5, 1,3] 



6.30965616% 
6.34520293% 
6.35204743% 
6.36255660% 
6.37338273% 
6.3767(5)% 



0.81071032 
0.80964391 
0.80943858 
0.80912330 
0.80879852 
0.80869(7) 



TABLE VI: For a given rii qubit bit flip code, we find the 
optimal 712 phase flip code for correcting noise of the form 
(px ,Py ,pz) = (p — p 2 ,p 2 ,p — p 2 ), i.e., independent noise at 
the unique set of parameter values qx = qz = P- The thresh- 
old values are determined to be the value of p for which the 
entropy is equal to 1. The hashing bound (corresponding to 
the 1 in 1 code) is p = 11.00278644%. These results are de- 
termined exactly. 



111 



Optimal 112 



Threshold 



7 
1 

25 
1 

77 
12 
221 

52 



11.21074102% 
11.00278644% 
11.23097281% 
11.16162540% 
11.27458434% 
11.20118393% 
11.27420360% 
11.20675588% 



logical entropy of 1. Smith and Smolin 0] were also able 
to evaluate the threshold for ri\ = 5 up to n% = 16 but 
not beyond this. However, for the n\ in 712 codes it is pos- 
sible to make efficient, exact calculations of the average 
entropy and threshold values. Fig. [5] shows the threshold 
values resulting from such exact calculations as a function 
of ri2 for the n\ = 5 qubit bit flip code concatenated with 
an ri2 qubit phase flip code. It is evident from this plot 
that the value n% = 51 is optimal, with a corresponding 
threshold value of p = 6.37338273%, with a correspond- 
ing channel fidelity of / = 1 - 3p = 0.80879852. Tab. 
IIVI shows the maximal thresholds as a function of ri2 for 
values of ni < 8. These results show that the highest 
threshold is obtained for n\ = 5,^2 = 51, by a consid- 
erable margin, and suggest that this code is therefore 
optimal for all ni, 712. 

As expected from the discussion in the previous sec- 
tion, it turns out that we can do even better by concate- 
nating 5 in n 2 codes repeatedly with the [[5, 1,3]] code. 
For this doubly concatenated code we need to make use of 
Monte Carlo sampling to evaluate the average Shannon 
entropy at the higher concatenation levels of the [[5, 1, 3]] 
code. We find that upon concatenating the 5 in 56 code 
10 times with the [[5,1,3]] code, the threshold value is 
p = 6.376753% ± 0.000006%, corresponding to a fidelity 
value of 0.80869740 ± 0.00000018. Tab. El compares this 
threshold value for the depolarizing channel with the var- 
ious 5 in ri2 codes discussed above and shows that the 
doubly concatenated code provides an improvement over 
all other existing codes. 



II. INDEPENDENT NOISE 

Suppose that we have independent rates qx of an X 
or Y Pauli error (some sort of bit flip), and qz of a Y 
or Z Pauli error (some sort of phase flip). Written in 
terms of Pauli error probabilities, this is {j>x,Py ,Pz) = 



{qx0- — Qz), qxqz,qz{l — qx)- Because they are detected 
independently of each other, the bit flips and phase flips 
can be corrected independently of each other. Therefore, 
information about the bit flip errors doesn't affect the 
correction of the phase flip errors, and vice versa. 

We apply an n\ qubit bit flip code concatenated with 
an 7i2 qubit phase flip code. Let the binary entropy func- 
tion be fb(p) = h(p) + h(l — p). For the X entropy, if 
we detect a distance k error, we have either a bit flip 
error with probability a ni ~k, or no bit flip error with 
probability a^. We perform an 712 degree multinomial 
expansion to get the total X entropy. After the bit 
flip code, the rate of phase flips is q' z = 1 ^ 1 ~^ gz - ) 1 . 
If a k = ( n £)q'£(l - q' z ) n2 ~ k , the Z entropy is" Z e = 
E fc K+«« 2 -fe)/6(^t^)' 

Making use of the results of Prop. [3l we have 2{qx(l — 

qx))i < (qx(l-2q Z )) 2 (l-qx) + ((l-qx)(l-2qz)) 2 qx, 
which gives a threshold of 

__ 1 - y/1 - (1 - 2q z Y 



For qx = qz, the critical value is qx — qz = \ — \ • 

For small qz, the optimal n\ is approximately n\ « 

and the threshold is (px,PY,Pz) = (| — e, |e 2 , ^e 2 )- 

Tab. I VII shows the ^-optimized threshold values for 
ni ranging from 1 to 8, in the case that the independent 
noise parameters are all equal, i.e., qx = qz = P- We 
find that the 5 in 77 code is best at correcting this type 
of noise, with a threshold value of 11.27458434%. This 
result is somewhat surprising, since this special case of in- 
dependent noise is the same as that in the second column 
of Tab. IIIII for pure bit flip codes, i.e., TI2 = 1. In the lat- 
ter case we found that the 7 qubit bit flip code performed 
slightly better than the 5 qubit bit flip code. In contrast, 
Tab. I VII shows that when the bit flip code is concate- 
nated with a phase flip code so that 712 > 1, the 5 qubit 
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bit flip code performs slightly better than the 7 qubit bit 
flip code. However, we find that we can do even better 
by repeatedly concatenating with the [[5, 1,3]] code. For 
example, for the 5 in 84 code concatenated 9 times with 
the [[5, 1, 3]] code, a threshold of 11.28061% ± 0.00005% 
is calculated, which is better than the optimal n± in ri2 
code of Tab. ED 

Fig. [3] shows a plot of the two-dimensional thresholds 
(qx, qz) for the general independent noise situation, with 
four different types of n\ in encodings. The hashing 
rate at which the noise entropy is 1 is shown as a red 
line for reference. The line of symmetry (brown line) is 
qx = qz- We divide the threshold behavior into two 
regions, before the symmetry line, qx < qz, and beyond 
the symmetry line, qx > qz- Before the symmetry line, 
i.e., for qx < qz, we find that among these four codes, 
it is optimal to apply a phase flip code first and then a 
bit flip code (which is reversed from an n\ in n<i code). 
After the symmetry line, i.e., for qx > qz, the optimal of 
these types of codes is to apply a bit flip code first and 
then a phase flip code (i.e., the usual n\ in ni code). Fig. 
[3] shows that the bit flip and phase flip bounds meet and 
cross at the symmetry line, as do the bit flip in phase flip 
and phase flip in bit flip bounds. 



III. TWO-PAULI NOISE 



TABLE VII: Bounds on non-zero capacity for different types 
of (px,Py,Pz) noise. The hashing bound is obtained when 
the entropy is 1. The bit flip code is the threshold from apply- 
ing the optimal bit flip code of length at least two. Bit/phase 
is the threshold from applying the optimal bit flip and then 
phase flip code combination. The lower bound given is the re- 
sult of taking the previous result and concatenating with the 
[[5, 1,3]] code repeatedly, as described in this paper. These 
are compared to the upper bound. 



(P,P,P) 



(p 



1 1 

P ,P ,P 



(p,0,p) 



Hashing 6.30965616% 11.00278644% 11.35460976% 

Bit flip 6.34520294% 11.21074102% 11.33392680% 

Bit/phase 6.37338273% 11.27458434% 11.39425214% 

Lower 6.3767(5)% 11.280(6)% 11.400(3)% 

Upper 8.3333% 14.6447% 16.6667% 



TABLE VIII: Shannon entropies of the channels at the thresh- 
olds in Tab. IVTll 



(P,P,P) 



(P- 



2 2 

-p ,P ,p- 



(p,o,p) 



Hashing 
Bit flip 
Bit /phase 
Lower 
Upper 



1 

1.00392304 
1.00702529 
1.00739(6) 
1.20752 



1.01248000 
1.01628620 
1.0166(4) 
1.20175 



1 

0.99885469 
1.00219124 
1.0025(3) 
1.25163 



We now consider noise of the form (px,PY ,Pz) = 
{Pi,P2,Pi)- We refer to this as two-Pauli noise. It is 
known that bit flip codes by themselves cannot correct 
two-Pauli noise up to the hashing bound near (p, 0,p) 
Tab. IIIII demonstrates that the 5 qubit bit flip code is 
the optimal bit flip code for correcting in this region. 

As can be seen in Fig. [4j we can correct above the 
hashing bound of p = 11.35460976% for (p,0,p) type 
noise by concatenating the m = 5 qubit bit flip code 
with an ri2 qubit phase flip code. The 5 in 74 code is 
optimal and yields a threshold of p = 11.39425214%. The 
5 in ri2 ~ 84 code concatenated 8 times with the [[5,1,3]] 
code yields a threshold of 11.40030% ± 0.00006%. 

Previous work f3| found that there always exists some 
bit flip or phase flip code that can correct up to at least 
the hashing bound for all Pauli noise, except for a neigh- 
borhood of this (p, 0,p) type noise. It had been conjec- 
tured [3J] that a neighborhood of this point was not cor- 
rectable. We have performed exact calculations which 
show that for physical noise at the hashing bound in this 
region such that px > pz, the 5 in 16 code (i.e., the 5 
qubit bit flip code in 16 code phase flip code) has a log- 
ical entropy of at most 0.9990331 (and goes to under 
repeated concatenation with the [[5, 1, 3]] code); therefore 
it can correct above the hashing bound in this segment of 
the region. The same applies to the symmetrical 5 qubit 
phase flip code in 16 qubit bit flip code for the comple- 
mentary segment px < Pz of the region. The thresholds 
for this 5 in 16 code are given in level 5 of Tab. [Ill There- 
fore the entire region around (p, 0,p) is correctable with 



a combination of these two codes. It follows that we can 
correct all Pauli noise below the hashing bound, disprov- 
ing the conjecture made in Q. It is still an open question 
whether this result applies to all non Pauli noise. 

We then find the optimal n\ qubit bit flip code for a 
given noise by optimizing over all lengths n\ < 150. The 
optimal value of n\ is always at least 5, and is approxi- 
mately fix « For small p\, Prop. Ogives a threshold 

of (p x ,PY,Pz) ~ (je 2 , | - e, je 2 ), which is very similar 
to that predicted by Prop. [3] in the case of small qz for 
independent noise. 

In Fig. 02 we show the threshold values of correctable 
two-Pauli noise as a function of p\ and p2 for n\ qubit 
bit flip codes with m < 150. 

IV. INFINITE LENGTH BIT FLIP CODE 

It can also be interesting to determine the thresholds 
for a bit flip code of infinite length. We find a threshold 
in terms of arbitrary (j>x,Py,Pz) values below. 

Proposition 3 Suppose a bit flip code with an infinite 
number of qubits n is used to correct independent noise 
on each qubit. There is a critical threshold of 

2(<7x(l - qx)) 1 < (px -py) 2 (l - qx) + (pi -pzfqx- 
If2(qx(l — qx)) 1 is below this, the logical entropy will 
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FIG. 3: (Color online) Threshold of the non-zero capacity for independent noise (px,PY,Pz) = (?x(l — qz), qxqz, qz(l — qx))- 
The yellow line shows the line of symmetry where qx = qz and the red line the hashing bound for which the noise entropy is 1. 
The bit flip (green line) and phase flip (blue line) bounds use the optimal bit flip and phase flip code, respectively (optimization 
was carried out up to n < 1 500). The bit flip in phase flip (purple line) and phase flip in bit flip (turquoise line) bounds use 
the optimal ni in 712 code for n\ < 9 and ri2 < 2f9. The bit flip and phase flip bounds cross at qz = qz — 11.21074102%, 
which is the threshold for the ni — 7 code when qx — qz, and the bit flip in phase flip and phase flip in bit flip bounds cross 
at qx = qz — 11.27458434%, which is the threshold for the 5 in 77 code when qx = qz (see Tab. IVIfl . The right hand panel 
shows an enlargement of the crossover region around the symmetry line. 




FIG. 4: (Color online) Threshold of the non-zero capacity 
for (px,PY,Pz) = (p,0,p) channel for 5 qubit bit flip code 
concatenated with a 712 qubit phase flip code. These values 
are determined exactly. 



be less than 1, and if 2(qx(l — qx))^ is above this, the 
logical entropy will be greater than 1. By concatenating 
by the optimal qubit phase flip code, these will go to 
(perfectly correctable noise) and 2 (completely depolariz- 
ing noise), respectively. 



Proof: From Stirling's approximation, 



n 



■, n +-. 



^tt (fn)f n+ i(n - fn) n -f n +i 



we have the formula 



lim 



»Vw f f 0--f) x - f 



2 H{f,i-n 



that we shall use. 

As n — » 00, the dominant contribution to the X en- 
tropy X e derives from li{k) and lx(k) for k near 5. 
Therefore 



Jim M e = lim \jh{-) 



= lim 



= 2V<7x(l - 



qx) 



(3) 



The Z entropy is dominated by the sum of the entropy 
contributions from Zj(fc) and Iz(k), which is given by 

k 

Up to second order, + e, | — e) w 1 — ce 2 where 

c = 21og 2 e; therefore 



E^-^) 2 )-i-iE(I)^ n - fc 



"2a k 



where g = (px ~ py) and h = ^- pz > . Letting k = fn, 

lim Vl _ ^ = max(fK(-A^) 1 -/, 
which is maximum for f — —r-r: therefore 

(p x -py) 2 , {pi-pz) 2 



(pi-pzY 



lim y/l — Z e = g + h 



qx 



1 - qx 
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FIG. 5: (Color online) Threshold of the non-zero capacity for two Pauli noise (px ,Py ,Pz) ~ (pi,P2,Pi)- For each type of noise, 
we use the optimal m qubit bit flip code with ni < 150. To the right of the "optimal up to here" point, a code with ni > 150 
would be optimal. These threshold values are determined exactly. 



To obtain the inequality in the proposition, we use 
this and linin^oo \J X e from Eq. [3l and note that 
linin^oo X e + Z e < 1 if and only if 

lim ^fX~ e < lim y/l — Z e . 

n — >oo n — >oo 

Hence 

2(gx(i-«x))* < (px ~py) 2 + (pi -Pzf, 

and multiplying by qx(l — qx) leads to the desired result. 

■ 

The entropy is when there is only one type of Pauli er- 
ror, and reaches its maximal value of 2 for the completely 
depolarizing noise (px,Py,Pz) = (j, j, j)- 

V. SUMMARY OF BOUNDS 

We now compare the lower bounds derived above to 
some known upper bounds on non-zero capacity that are 
given by [T3 ] : 

Px + Py + Pz + \/PxPy + VPyPz + VPzPx < (4) 

We can use this expression to obtain upper bounds on 
the types of noise studied in this work. The correspond- 
ing upper bounds are given in Tab. IVIII As stated previ- 
ously, the hashing bound is when the entropy is 1 without 



applying a code. The bit flip code rates are the maximum 
attainable with a bit flip code. The next row is the max- 
imum obtainable with a bit flip code concatenated with 
a phase flip code. The best known lower bounds on the 
thresholds are those described earlier in this work. They 
were found by repeatedly concatenating the bit flip in 
phase flip code (n\ in n 2 ) with the [[5,1,3]] code. The 
Shannon entropies of the channels at the threshold val- 
ues from Tab. EH are given in Tab. IVTTT1 Note that the 
channel entropy depends on the type of noise. In particu- 
lar, the best known improvement over the hashing bound 
is 6 times as high for the (p — p 2 ,p 2 ,p — p 2 ) type noise as 
for the (p, 0,p) type noise. 



In Tab. IVIII we see that the pure bit flip codes can 
correct above the hashing bound except near (p, 0,p). 
Further improvement is found by concatenating the bit 
flip code with a phase flip code; this always corrects up to 
at least the hashing bound for any Pauli noise. Repeated 
concatenation with the [[5,1,3]] code gives some minor 
additional improvement. Clearly, there is a large gap 
between the best known lower and upper bounds. We 
conjecture that the ultimate thresholds on the non-zero 
capacity are much closer to the lower bounds than the 
upper bounds in Tab. IVIII However, we expect that the 
new lower bounds found in this paper will not be the 
ultimate threshold values. 
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VI. SUMMARY AND DISCUSSION 

In this paper we have established new lower bounds 
for the non-zero capacity of noise quantum channels, us- 
ing an entropic approach to calculation of thresholds of 
correctable noise. Our analysis consisted of two steps: 
first, performing exact calculations to find the thresholds 
below which the n\ in 712 code results in a logical entropy 
of less than 1. We then further concatenate the n\ in n-j 
code a number of times j with the [[5,1,3]] codes and 
use Monte Carlo simulation to evaluate the correspond- 
ing threshold values. We applied the procedure to various 
kinds of Pauli noise and found that this double concate- 
nation yields improved threshold values over previously 
existing codes in all cases. Our results show that Pauli 
noise is correctable up to the hashing bound, disproving 
a recent conjecture that there exists some uncorrectable 
Pauli noise below the hashing bound Q. 

The doubly concatenated codes presented here result 
in one logical qubit encoded in nxn^ physical qubits. 



They can then be further concatenated with random 
codes, as in 0,0], to generate a non-zero capacity code. 
Unfortunately, since extrapolation of the Monte Carlo 
simulation results to zero error introduces some uncer- 
tainty by virtue of their stochastic nature, these doubly 
concatenated codes do not provide a constructive route 
to non-zero capacity codes in the current analysis. The 
results are nevertheless strongly suggestive that a con- 
structive procedure based on these or related codes might 
be possible. The doubly-concatenated encoding analyzed 
here thus provides a basis for further efforts towards the 
challenge of finding constructive encodings for finite ca- 
pacity quantum channels. 
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